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Abstract 

The paper proposes a new approach to consistent stochastic utilities, also called forward 
dynamic utilities, recently introduced by M. Musiela and T. Zariphopoulou [26]. These utilities 
satisfy a property of consistency with a given incomplete financial market which provides them 
properties similar to the function values of classical portfolio optimization. The additional 
assumption of the existence of optimal wealth plays a key role in this paper. Using Ito-Ventzel 
formula, we derive two forward non linear stochastic PDEs of HJB type satisfied by consistent 
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stochastic utilities processes of Ito type and their dual convex conjugates. We characterize the 
volatility of consistent utilities as an operator of the first and the second order derivatives of the 
utility in terms of the optimal primal and dual policies. Making the assumption that the SDEs, 
associated with the optimal policies, are solvable with monotone solutions with respect to their 
initial conditions, we characterize all consistent utilities for a given increasing optimal wealth 
process as the primitive of the composition of the dual optimal process and the inverse of the 
optimal wealth. Also, we establish a connection between the fully nonlinear second order utility 
SPDE and two stochastic differential equations associated with optimal policies, which allows 
us to reduce the resolution of the utility HJB-SPDE to the existence of monotone solutions of 
the SDEs. 

Introduction 

Recently, the concept of forward dynamic utilities has been introduced by M. Musiela and T. 
Zariphopoulou (2004-2007) [Ml EU E3 E3 EU , to model possible changes over the time of 
individual preferences of an agent. Such a concept has also been studied by F. Berrier, M. 
Tehranchi and C.Rogers (2009) [10] and G. Zitkovic |46| . Further works related to this problem 
are T. Choulli, C. Strieker and L. Jia (2007) [3], V. Henderson and D. Hobson (2007) [13] . 
The economic agent will adjust its preferences based on the information that is revealed over time 
and represented by a filtration {J~t,t > 0), defined on the probability space (f2, P, (J-t, t > 0)). In 
contrast to the classical literature, there is no pre-specified trading horizon at the end of which 
the utility datum is assigned. Rather, the agent starts with today's specification of its utility, 
U(0, x) = u(x), and then builds the process U(t,x) for t > in relation to the information flow 
given by (J-t,t > 0). This, together with the choice of a initial utility, distinguishes the forward 
dynamic utility from the recursive utility for which the aggregator can be specified exogenously 
and the value function is recovered backward in time. 

Working with positive wealth processes X n in an incomplete market, we define a consistent 
stochastic utility as a progressive non negative stochastic utility U(t,x), for which U(t,X[) is 
a supermartingale, and a martingale for one optimal wealth. However we restrict our study to 
forward utilities which are Ito-semimartingales with spatial parameter x, whose local charac- 
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teristics (j3, 7) are such that 

dU(t,x) = P(t,x)dt + j(t,x).dW t . 

The key tool is the Ito-Ventzel's formula which we recall at the beginning of Section [5J As in 
the classical Hamilton-Jacobi-Bellman framework, we proceed by verification to establish the 
dynamics of consistent utilities. Assuming a sufficient constraint on the drift (3 of HJB type, 
we get the utility stochastic PDE that we investigate in this paper. In particular, we study 
the role of the utility risk premium defined by iff (x) = Jx/Uxft, x). Section [3] goes into details 
on the question of duality and gives a characterization of the non linear SPDE satisfied by 
the progressive convex conjugate U of U. This allows us to obtain a complete interpretation 
of the volatility 7. Unlike the backward case, we do not a priori give a positive answer on 
the question of existence and uniqueness of solutions of the primal and dual Hamilton-Jacobi- 
Bellman equations established in this work, but show the important role of the volatility 7 
of the stochastic utility U and the strong analogy between the primal and dual problem. The 
obstacles in the analysis come from the fact that the HJB equations are forward in time and also 
without maximum principle. Therefore existing results of existence, uniqueness and regularity 
of weak (viscosity) solutions are not directly applicable. An additional difficulty comes from the 
fact that the volatility random field may depend on higher order derivatives of U, in which case 
the SPDE can not be turned into a regular PDE with random coefficients, using the method of 
stochastic characteristics. Moreover, the concavity property can not be derived directly from the 
dynamics; this still an open question in general, which we try to answer in Section UJ In Section 
[3j we focus on the convex conjugate function U(t,y) of U(t,x). We show that this conjugate 
random fields is a solution of a dual Utility-SPDE and is consistent with the familly of state price 
density processes, in particular, there exists an optimal choice Y* which plays an important role 
in this paper. In Section [3.31 we show the stability of the notion of consistent utility by change 
of numeraire and then, without loss of generality, we can consider the martingale market where 
the portfolios are simple local martingales and the stochastic PDE's are easier to deal with. 
In Section [U we establish the most original contribution of this paper, that is a new approach 
to consistent dynamic utilities based on the stochastic flows associated with the optimal wealth 
and the optimal state price process and their inverses. The idea is very simple and natural: 
Suppose that the optimal portfolio denoted by X£(x) is strictly increasing with respect to the 
initial capital, and denote by (X(t,x)) the adapted inverse process, defined by X£(X(t,x)) = x. 
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Then, using the dual identity U x (t,X£(x)) = Y*{u x {x)), we can find U x (t,x) from U x (t,x) = 
y(t, X(t,x)) where (Y t *(y)) is the optimal state price density process and y(t,x) := Y t *(u x (x)). 
Finally we get U by integration. So, we are able to generate all the consistent utilities with a 
given optimal portfolio. 

The problem of recovering the utility function coherent with a given optimal portfolio is known 
in the financial literature as the "inverse" Merton problem; it has been considered by many 
authors in the past in particular by H.He and C.Huang (1992), [12]. In the classical expected 
optimization problem, there are restrictions to put so that the portfolio is consistent with a 
deterministic utility criterion at some fixed time horizon. These difficulties disappear when the 
criterion is a progressive utility as we show in this paper. 

The study provides a fine analysis of the utility volatility vector and its derivative in terms of 
optimal allocation policy and optimal choice of state price density. In fact, given these optimal 
policies, the volatility vector 7 is interpreted as an operator T(x, U x , U xx ) which is linear in U xx 
and depend on U x (resp. x) as how the volatility of the flow y (resp. X*) depends on y (resp. 
X*). 

To the best of our knowledge, the fully non linear utility stochastic PDE's established in this 
paper and satisfied by forward utilities and their dual have not been established in a general 
way. In [TU] and [35] the authors study the case where the volatility vector of the utility is 
zero. In |32j . the authors derive a stochastic PDE and study examples where the volatility of 
the utility is constant, proportional to U (case of change of probability) and the case where the 
volatility is proportional to xU x which corresponds to a change of numeraire. 
Furthermore, to our knowledge, there is no general consistent utilities construction proposed in 
the literature, expect the case of power or exponential type, or decreasing utilities. 

Another main contribution of this paper is a connection between two solvable SDEs and the 
utility SPDEs early established. In particular, given a volatility vector 7 such that "f x (t,x) = 
—xU xx Kt(x) + Vt(U x (t,x)), we show the existence and uniqueness of a solution to the fully 
nonlinear second order SPDE from that of a pair of SDE's. In any case this represents an 
interesting result in the theory of stochastic partial differential equations. 

The paper is organized as follows, we give the definition of consistent dynamic utilities. Then, 
in order to study the HJB Stochastic PDE, we give more precisions on the market model. In 
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Section [2l we introduce the useful Ito-Ventzel formula and we provide the dynamics of consistent 
utilities and a closed form for the optimal policy and we give an example of consistent utility 
obtained by combining a standard utility function with some positive processes. In Section [3l 
we study the dual process and establish a duality identity. In Section 13.31 we show the stability 
of the notion of consistent utility by a change of numeraire. In Section U we present our new 
approach and the main results of this work. 

1 Consistent Stochastic Utilities 

We start by introducing the concept of a forward utility consistent with a given family of 
portfolios. All stochastic processes are defined on a filtered probability space (f2, J-t>o,P) with 
complete filtration (J-t)t>o satisfying the usual conditions. In general, J-o is assumed to be trivial. 
In the Ito framework considered afterwards, (J-t)t>o will be usual an augmented Brownian 
filtration. 

1.1 Definition of Consistent Stochastic Utilities 

A progressive utility U is a positive adapted continuous random field U(t,x), such that t > 0, 
x > i— > U(t,x) is an increasing concave function (in short utility function). 
Obviously, this very general definition has to be compelled to represent more realistically the 
individual preferences of an investor in a given financial market, possibly changing over time. 
The idea is to calibrate these utilities with regard to some convex class (in particular vector 
space) of wealth processes, denoted by on which utilities may have more properties. 
As classical utility function, a progressive stochastic utility measures the relative satisfaction 
of any portfolio and gives a selection criterion which allows to identify an optimal choice of 
investment at any time. In general, we will impose below the uniqueness of the optimal process, 
to be as close as possible to the usual expectations of investors. Furthermore, the satisfaction 
for the optimal choice is maximum and will be preserved at all futures times which explains the 
martingale property in the definition below. On the other hand if the strategy in SC fails to be 
optimal then it is better not to make investment. The fact of making a bad investment choice 
can be seen as a loss, compared with what he could won if he had followed the optimal policy. 
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From this, we suppose that the utility of any strategy is a supermartingale and so the optimum 
represents the reference (benchmark) for the investor. 

The class SC is a test-class which only allows us to specify the stochastic utility. Once his utility 
is defined, an investor can then turn to a portfolio optimization problem on the general financial 
market to establish his optimal policy or to calculate indifference prices. 
Now we are able to define the ^-consistent stochastic utility as follows. 

Definition 1.1 (^-consistent Utility). A 36 -consistent stochastic utility process U(t,x) is 
a positive progressive utility with the following properties: 

• Consistency with the test-class: For any admissible wealth process X £ !% , E(J7 (t, Xt)) < 
+00 and 

E(U(t,X t )/T s ) < U(s,X s ), Vs < * .a.s. 

• Existence of optimal wealth: For any initial wealth x > 0, there exists an optimal 
wealth process X* e Jf, such that X% = x, and U(s,X*) = E(U(t, X*)/F s ) Vs < t. 

In short for any admissible wealth X € !% ' , U(t,Xt) is a positive supermartingale and a mar- 
tingale for the optimal-benchmark wealth X* . 

Our definition of consistent dynamic utilities differs from the one introduced by Musiela and 
Zariphopoulou [26l [291 EH OB [32] or Barrier and al. [10] by the fact that we do not require 
that the wealth processes X are discounted. This variation offers more options and allows us 
to study the invariance of the class of stochastic utilities by change of numeraire. In any case, 
there is no fixed horizon. 

Remark A deterministic utility u is a JT-consistent utility only when the test-portfolios are 
local martingales. In this case, the optimal strategy is to do nothing. 

The Market Model In this paragraph, we follow the presentation of Karatzas and Shreve 
[19] . We consider a securities market which consists of d + 1 assets, one riskless asset, with 
price S° given by dS® = S^rtdt and d risky assets. We model the price of the d risky assets as 
a locally bounded positive semimartingale S l , i = 1, . . . ,d defined on the filtered probability 
space (S7, J^>o, P). 

A (self— financing) portfolio is defined as a pair (x, <f>), where the constant x is the initial value 
of the portfolio and the column vector <p = {4> l )i<i<d is a predictable 5-integrable process 
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specifying the amount of each asset held in the portfolio. The value process, also called wealth 
process, = (xf) t >o of such portfolio <fi is given by 

Let us denote by X + the set of non negative wealth processes. To facilitate the exposition 
we only consider wealth processes in X + . This naturally leads us to characterize portfolios by 
means of relative weights ir in place of the amounts <j). The relation between these two notions 
is easy since <pt = (jj\xf{x), ..,Trfxf(x)) T , where the transpose operator is denoted by T . The 
advantage of the second formulation is that the assumption of positive wealth is automatically 
satisfied, since the previous equation becomes with the notation X n in place of 

dXY , dSf , . , , 

— f = rt dt + TT t .(— - -nidi), t>0 (2) 
X t S t 

where the <i-dimensional vector denoted by 1 is such all components are equal to 1. Let us now 
recall that a probability measure Q ~ P is called an equivalent local martingale measure if, for 
any X € X + , ^ is a local martingale under Q. To ensure the absence of arbitrage opportunities, 
we postulate that the family of equivalent local martingale measures is not empty, (see [5], [B] 
for a precise statement and references). We stress that no assumption concerning completeness 
is made and in particular, many equivalent martingale measures may exist. 

Ito's Market: Let W = (Wi, W2, W n ) T be a n-standard Brownian motion (n > d), 
defined on the filtered probability space (fi, J 7 , P). The filtration {Tt)t>o is the P-augmented 
filtration generated by the Brownian motion W . 

The risky asset prices are continuous Ito's semimartingales with the dynamics: 

= b\dt + a\.dW u for < i < d (3) 

where the inner scalar product is denoted by " ." . The coefficient b l represents the appreciation 
rate by time unit of the asset i and a 1 its volatility vector in R n , considered as a n x 1 matrix. 
Denote by b the appreciation rate column vector n x 1 (& 2 ) i=1 ^, and by at the volatility matrix 
n x d (n lines d columns), whose i th column is the vector a\ for i = l,...,d. The processes b, 
a and r are Tt non-anticipating processes and satisfy some minimal appropriate integrability 
conditions. Using vector and matrix notation, we have dS t = S t (b t dt + a? dW t ) Mor eover, 
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equation (|2|) may be rewritten as, dXf = X^[(rt + nt-fit — rt)l)dt + atir t .dWt\ ■ As usual, the 
matrix (aa T )(t,oj) is assumed to be non singular. This assumption is equivalent to suppose 
that, for any % € l..d, the asset S l can not be replicated by an admissible portfolio. The existence 
of an equivalent local martingale measure in this framework implies that the excess of return 
vector belongs to the range of volatility matrix: in other words, there exists a .^-progressively 
measurable process r\ £ M. n such that b% — r^l = afrjt. Additional integrability Assumptions are 
necessary to ensure that the exponential martingale generated by rj.W is the density of some 
probability measure. 

We get that the dynamics of the portfolio becomes dX£ = X^[r t dt + atirt.(dWt + Vtdt)] The 
key role is played by the volatility vector air. For this and in order to facilitate the exposition, 
we denote it by k := an. To fix the notation, we denote by TZ" C R n the range of at, and by 
TZ^ ± the orthogonal vector subspace. By assumption, Kt is required to lie at any time t in Vf t . 
Replacing X w by X K , the above equation becomes 

dX? = X? [r t dt + K t .(dW t + Vt dt)) , K t G Til (4) 

Note that under market assumptions {ajat non singular) there exists a unique vector 7it such 
that Kt = atiTf 

The following short notation will be used extensively. Let 1Z a be a vector subspace of M n . For 
any a € K n , a a is the orthogonal projection of the vector a onto TL a and a 1 - is the orthogonal 
projection onto TZ a '^. To express the orthogonal projection onto lZ a , Musiela and Zariphopoulou 
|32j use the generalized inverse of a, known as the Moore- Penrose inverse a + , characterized by 
the following identities 

aa + = (aa + ) T , a + a = (a + a) T , aa + a = a, a + aa + = a + 

Indeed aa + is the orthogonal projection matrix onto lZ a , and a a = aa + a. 

Minimal Risk premium The market incompleteness is described through the family of 
risk premium r/. Since for any k G lZ a , k.tj = K.rf , we assume throughout this paper and 
without further mention that rj = ff € Tt a ■ rf is often referred to as the minimal risk premium. 
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2 Stochastic Partial Differential Equation 



In this section, under some additional regularity assumptions, we focus on the Hamilton- Jacobi- 
Bellman stochastic PDE satisfied by a ^-consistent stochastic utility using essentially Ito- 
Ventzel's formula and techniques of dynamic programming established and developed in the 
classical theory of utility maximization (see for example H. Pham |14j). Additional regularity 
assumptions are necessary to advance in the study. From now, ^"-consistent stochastic utilities 
U(t,x) (U(0, .) = are described as Ito's semimartingales with spatial parameter x > 0; in 
other words, U(t, x) is a continuous random field with dynamics, 

dU(t,x) = (3(t,x)dt + j(t,x).dW t , (5) 

where, as in Kunita [25], the local characteristics 7) of U and are assumed to be progressively 
random fields with values in K and R n respectively. 

We are concerned with the properties of the utility of admissible wealth processes. Before 
that, we want to give precise definition of the progressive utility, assumed to be of class C 2 , its 
derivatives and their dynamics properties. 

2.1 Regular stochastic flows and Ito-Ventzel's formula 

Regular Stochastic flows There are several difficulties in the definition of semimartingales 
depending on a parameter, as explained in H. Kunita |25j and R.A. Carmona et al. [2], (see 
Appendix |A|) . 

First let us point out that in general equality © holds for any t except for a null set N x . Then 
the semimartingale U is well defined for (i, x) if to £ (U^gR.A^) . However the exceptional set 
(U xG r + A^;) may not be a null set since it is an uncountable union of null sets. However if we 
suppose that local characteristic (,$,7) of U are 5- Holder, for some 5 > (see appendix[A}, then 
according to H. Kunita [25] (Theorems 3.1.2 p. 75) using Kolmogorov's criterion, U(t,x) has a 
continuous modification for which ([5]) holds almost surely. 

A detailed discussion about these difficulties and their consequences in terms of dynamic rep- 
resentation and differential rules are provided in H. Kunita |25| and R.A. Carmona et al. [2]. 
The main results are also recalled in Appendix [A] Here we only give a self-contained defini- 
tion of the regularity in the sense of Kunita [25]. In particular, albeit the process U and its 
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local characteristics 7) are differentiable it is not enough as is shown in H. Kunita [25], 
to get that the dynamics of the derivative -^U(t,x) is the derivative term by term of that of 
U. Let m be a non-negative integer, f3 be a real function in C m ([0, +oo[x [0, +00 [) and 7 be a 
C m ([0, +oo[x [0, +oo[) vector. We define the following seminomas for any compact K, 



** K 1 + ' X I l£Z.m** K 



|| 7 ||^(t)= sup I^M)-7(^)I J2 sup \d^d^ T (t,x)Mt,y)\ 

For simplicity if a random field (G(t, x))t>o,x>o is of class C°' 2 ([0, +oo[x [0, +00 [) we use the 
notation G x for J^G and G xx for -§^iG. 

Definition 2.1. Let m > 2 and F be a random field with spatial parameter x defined on 
R+ x R + — > R with local characteristics (/3,7), 

F(t,x) = F(0,x)+ f P{s,x)ds+ [ j(s,x).dW s . (6) 
Jo Jo 

According to Kunita f25f . F is said to be C( m ) regular in the sense of Kunita if 

• F is continuous on the time and of class C m (R+) on x. 

• /3 : R_|_ x R + — > R and the N -dimensional vector 7 : R+ x R + — > R N are T -adapted 
random field continuous on the time and are of class C m-1 (R+) on the spatial parameter x 
such that \\P\\m—i:K(t) an d WlWm-i-K^) are i n tsgrable with respect to t, for any compact 
K C [0,+oo[. 

Now we turn to the differential rules of semimartingales with spatial parameter. For this 
some other notations are needed. Let < 5 < 1 and K a compact of R+. For some random 
fields f(t,x) and g(t,x,y) we set 

I,,,, \ d %f( x ) ~<%f(y)\ I, I, \g(x,y) - g{x',y) - g{x,y r ) +g{x',y')\ 

\\j\\6:K '■ = SUp : ^ , \\g\\S:K ■= SUp : jrg ^ , 

x,yel< \ x ~ V\ x,x',y,y'eK \x — x \ \y — y 1 

x+y x+x\y+y' 

Using these notations and according to Kunita [25], (Theorem 3.3.3 p. 95, recalled in Appendix 
|A|) . we have the following differential rules. 
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Theorem 2.1 (Differential Rules). Let F be a random field of class C 0,1 ([0, +oo[x [0, +00 [) such 
that its local characteristics (/3, 7) are of class C 0,1 ([0, +00 [x [0, +oo[). Assume that the derivative 
(3 X and j x are 5-Hdlder, with < 5 < 1 such that for any compact K o/R+, 1 1/3| \s:k{P) an d 
IW^Ws-.Kit) are integrable with respect to t, with a 7 (i, x, y) := j(t, x) T .j(t, y). Then the derivative 
F x of F with respect to the spatial parameter x satisfies, almost surely, 

F x {t,x) = F x (0,x) + [ fi x (s,x)ds+ [ lx {s,x).dW s (7) 
Jo Jo 

Furthermore, if F is of class C^ m \ m > 2 in the sense of Kunita then F x is of class C^ m ~ 1 ^ in the 
sense of Kunita with local characteristics (/3 x ,-y x ) which are of class C 0,m-2 ([0, +00 [x [0, +00 [). 

Ito-Ventzel's formula Now, we need to study the dynamics of U(t,X^) (X K is a wealth 
process). Ito-Ventzel's formula is a generalization of classical Ito's formula where the determin- 
istic function is replaced by a stochastic process depending on a real or multivariate parameter. 
This enables us to carry out computations in a stochastically modulated dynamic framework. 

Theorem 2.2 (Ito-Ventzel's Formula). Consider a random field F : [0, +oo[x [0, +oo[— >■ R 
which is of class in the sense of Kunita, 

F(t, x) = F(Q, x) + I (3(s,x)ds+ [ j(s,x).dW s , a.s. (8) 
Jo Jo 

Furthermore, let X be a continuous semimartingale with decomposition 

X t = X + [ fifds + f af.dW s 



Jo Jo 

Then (F(t,Xt)) is also a continuous semimartingale with decomposition 

F{t,X t ) = F(0,X )+ f t p(s,X s )ds+ f\(s,X s ).dW s 

Jo Jo 

+ [ F x (s,X s )dX s + l [ F xx (s,X s )(dX s ) 
Jo * Jo 

+ / lx {s,X s ).afds. 
Jo 

Let us now comment the dynamics of F(t,Xt). The first line of the right hand side of this 
dynamic corresponds to the dynamics of the process (F(t,x))t>o taken on (Xt)t>o, where the 
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second one is none other than the classical Ito formula, and the last one represents a correction 
term which can be written ^y x (s, X s ).a x = (dF x (s,x),dX s )\ x= x s - 

We refer to Kunita [25], (Theorem 3.3.1, p. 92) for more details and the proof of this result. In 
the following example, we illustrate this formula from the classical Ito's formula. 

Example: Ito's Formula Let f(t,9,x) be a deterministic function M. + x K x 1™ ^ R of 

class C 1,2 ' 2 . Denote by V# the gradient with respect to 9 and by Ago the Hessian matrix with 
respect to 6 where t and x are fixed. 

Let € M. n be an Ito's semimartingale dOt = fJ>fdt + S 4 ' dWt, with the diffusion generator 
Lf = J^/(i, Q t ,x) + fifVe + l -trace[T,f T ^f Age]. 

def 

Denote by F the stochastic random field F{t,x) = /(t,0^,x). By the classical Ito's formula 

dF(t, x) = Lff(t, & t , x)dt + Sf Vgf(t, & t , x).dW t 

such that F is a stochastic random field with local characteristics f3 F and j F given by 

? F (t, x) = Lff(t, @ t , x), 7 F (t, x) = Ef V e f(t, @ t , x). 

Let now X be another real continuous semimartingale dXt = \x x dt + a x .dWt and L x its 
stochastic diffusion operator without the term on Jj. 

We now compute the dynamics of F(t,Xt) := f(t,Qt,Xt) by the classical Ito's formula applied 
to the vector (Qt,Xt), with diffusion generator L ,x , and compare it with the Ito-Ventzel's 
formula. We obtain 

dF(t, X t ) = Lf' X f(t, Q t , X t )dt + (Sf V e f(t, Q t , X t ) + f x (t, G t , X t )a x ^j .dW t 
= (3 F (t, X t )dt + 7 F (t, X t ).dW t + 7 f (i, X t ).a x dt + Lf f(t, Q t , X t )dt 
+ f x (t,e t ,X t )a x .dW t . 

Denoting A e>x f := Vgf x , Lf' X := Lf{t, 9,x) + L x (t, 9, x) + af .of A B>x f(t, 9, z), and then, 

7 f (t, X t ).a x dt = EfV e f x (t, Qt, X t ).a x dt = ^ f xfij < d@{,dX t > . 

j 
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2.2 Stochastic PDE of JT-consistent Dynamic Utilities 

Using the same ideas as in interest rate modeling when studying the dynamics of the forward 
rates, or in the stochastic volatility models to characterize the drift of the stochastic implied 
volatility, we show how the consistency property constraints the random fields /3(t, x) and -f(t, x) 
in terms of the random field U, its derivatives and the market parameters (rt,rif). 

Lemma 2.3 (Drift Constraint). Let U be a progressive utility of class in the sense of 
Kunita with local characteristics (/3,7) as in (EJ). Then, for any admissible portfolio X K , 



dU(t,X?) = (U x (t,X?)X? Kt + 'y(t,X?)).dW t 

+ (p{t,X?) + U x (t,X?)r t X? + ±U xx (t,X?)Q(t,X t K ,K t ))dt, 
whereQ(t,x,K) := \\xk\\ 2 + 2a*. ( ^ X) f + ^ X) ) . 

U xx (Pi •£) 

Since k € 1Z a , Q(t,x,n) is only depending on j x (t,x), the orthogonal projection ofj x (t,x) on 
1Z% . Let Q*(t,x) = inf Ke 7£<r Q(t,x,n); the minimum of this quadratic form is achieved at the 
optimal policy k* given by 

xK t( x ) =-u^){ u s^)v a t +r x {t,x)) 

x 2 Q*(t, x) = - u -^ w \\U x (t,x)r l ? + 7 °(t,x))\\ 2 = -\\xK* t (x)\\ 2 . 

Remark 2.1. Similar results may be established when the volatility vector of wealth processes has 
an affine form Rt = m + at, Kt £ TZf, at € and the market risk premium is a general i]. In 
this framework the quadratic form is unchanged, Q(t,x,R) = \\xR\\ 2 + 2xR. ( ^i*yZ^t^fe£) ) }) U i 
the optimization program is related to affine constraints, Rt — at £ TZf . Denoting Q*(t,x,a) := 
mi fie n<T +a Q(t,x,R), the optimal policy is 



U x (t,x)r]t + j x (t,x) U x (t,x)rfi + j x ~{t,x) ± 

XKt = xat + ( Ux~xJt~c) xat) = TU^) + ^ (10) 



and finally 

q*u x a \ = u UJ^^+J^x) xa Ln2 ^ U x(t,x)r] t + j x (t,x) ^ 2 
U xx (t,x) 1 U xx (t,x) 

This identities will be used extensively in the study of the dual process and the transformation 
by change of numeraire. 
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Proof, (i) The first assertion is a direct consequence of Ito-Ventzel formula applied to the 
composite process (U(t, X t K )) t>Q , where X* is an admissible wealth process with dynamics 
given by @, dX? = X t K (r t dt + K t .(dW t + rfidt)) . 

(ii) The minimization program of the quadratic form Q(t, x, k) corresponds to the square of the 
distance between _ an( j the vector space 1Z1 , that yields to equation ©. Then, 

the minimum is given by Q*(t,x) = — | |x«|(aj)| | 2 . □ 

This lemma suggests that the constraint on the drift j3 implies the consistency condition. The 
idea of the next theorem is to reformulate this constraint as a natural candidate for j3. 

Theorem 2.4 (Utility-SPDE). Let U be a progressive utility of class in the sense of Ku- 
nita with local characteristics (/3,7). Let us introduce the risk tolerance coefficient cq (t, a;) = 
— u x ^fx) an d utility risk premium rj u (t, x) = ^'"^ with its two components i] U ' a € lZ a , r^' 1 - € 



The quadratic form x 2 Q(t,x, k) = \\xKt\\ 2 — 2a u (t, x)(xKt)-(r]f + rff' a (x)) achieves its mini- 
mum at the optimal policy, 



XK* t {x) 



1 



■(U x (t,xX + = a u (t,x)(^ + n^(x)) 



U xx (t) X~) 

a) Assume the drift constraint to be of Hamilton-, J acobi- Bellman nonlinear type 

(3{t,x) = -U x (t,x)r t x + -U xx (t,x)\\xKt(t, x)\\ 2 



(12) 



(13) 



Then the progressive utility is a solution of the following HJB-SPDE 

dU(t,x) = -U x (t,x) \xr t + ^a u {t,x)\\if t +i 1 ^ a {x)\\ 2 \dt + 1 {t,x).dW u 

and for any admissible wealth X£ , the process U(t,X^) is a supermartingale. 

b) Furthermore, if k* (x) is assumed to be sufficiently smooth so that for any initial wealth x > 0, 
the equation 

dx; = x; [r t dt + 4{x* t ).(dw t + tfdt)] (u) 

has at least one positive solution X* , then U(t,X*) is a local martingale. 

c) Moreover, if this local martingale (U(t,X^)) t>0 is a martingale, then the progressive utility 
U is a 3C -consistent stochastic utility with optimal wealth process X* . 
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This theorem proves that the pair consisting on the investment universe and the derivative with 
respect to x of the volatility denoted by 7^ describes completely the evolution of the stochastic 
utility U. The drift /3(t, x) may be interpreted in term of the risk aversion r] U and the volatility 
7 of the utility. The optimal policy k* is the best combination between the market risk premium 
rf and the utility risk premium r^ ,a (x) = jj^. 

The assumption (|13p on the drift (3 is a sufficient condition under which the consistence with the 
investment universe of the second assertion of Definition 1 1 . 1 1 is satisfied. Nevertheless, additional 
assumptions are needed on the existence of the wealth process X* for which (U(t,Xf)) t>Q is a 
martingale. This explains the assumptions of the second part of the result. 

The Utility-SPDE poses several challenges. It is a fully nonlinear and non elliptic SPDE; 
the latter is a direct consequence of the "forward in time" nature of the involved stochastic 
optimization problem, for which there is no maximum principle. Thus, existing results of ex- 
istence, uniqueness and regularity of weak (viscosity) solutions are not directly applicable. An 
additional difficulty comes from the fact that the volatility coefficient may depend on higher 
order derivatives of U, in which case the SPDE can not be turned into a regular PDE with 
random coefficients by using the method of stochastic characteristics. To overcome these diffi- 
culties, we propose a new method based on a stochastic change of variable; this method, that 
we call "stochastic flow method", allows us to construct explicit solutions of this Utility-SPDE. 
This will be the subject of Section [H 

Proof. All assertions are simple consequences of the previous lemma, since by the assumption 
on /3(t,x), P(t, x)+x U x (t, x) r t + Q(t, x, k) < 0, a.s. Vk € 11°, with equality for K* t {x). 

Therefore, U(t,X*) is a positive supermartingale for any admissible strategy, and if equation 
([H]) has a solution X*, then the process (U(t, X£ )) t>0 is a local martingale. 
The additional assumption that (U(t,X*)\ is a true martingale yields the characterization of 
the U(.,x) as ^-consistent utility. □ 

Example: Change of probability and numeraire in standard utility function 

In this example, we study the /3-HJB constraint f)13j) of Theorem 12.41 in the case of a JT- 
consistent stochastic utilities obtained by combining a standard utility function v with some 
positive processes N and Z. The advantage here is that the drift j5 and the volatility 7 of the 
utility are given explicitly from v, N and Z. 
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Let v an C 2 utility function and let N and Z two positive processes satisfying 

Define the strictly increasing and concave process (with respect to x) U by U(t, x) = Z t v(x/ N t ). 
Applying Ito's Lemma and using identities U x (t,x) = jr t v x (j^), U xx (t,x) = jfav xx (jfc), it is 
straightforward to check that, for x > 0, the process (U(t, x)) t >o satisfies dU(t,x) = (3(t,x)dt + 
j(t,x).dWt where the local characteristics /3 and 7 are given by 

P(t,x) = U(t,x)fif + xU x (t,x)(-»? + \\a?\\ 2 -a?.a?) + ±x 2 U xx (t,x)\\a?\\ 2 (15) 
j(t,x) = U(t,x)af - xU x (t,x)a? . (16) 

Given that U is a progressive utility, we are interested in establishing conditions on the triplet 
(v,N,Z) for the drift (3 satisfies the HJB constraint (|13D . 

Proposition 2.5. Let v be an utility function. 

(i) The process U defined by U(t,x) = Ztv(x/Nt) is a consistent stochastic utility if Z is a 
martingale, ZX K /N, k G W are positive local martingales and a N G 1Z a . In this case the 
optimal policy is given by «| = af^ . 

(ii) In the special case where v is a power or an exponential utility, then Condition : "Z is 
martingale, ZX K /N is a local martingale for any k G TZ a " can be relaxed. 

— If v is a power utility with risk aversion a ^ 0; v(x) = it suffices that the 
parameters of Z and N satisfying, 

1 Z , N , N cr N,± Z,± . 1 ii <t JV.tr . Z,a\\2 , 1 + a 11 iV,_L M 2 n 

— A*t +n-IH + a t -Tit ~°t -<V + 2(1 - a) " Vt ~ Gt * " ~~2~ " * " ' 

so that U(t,x) = Z t v(x/N t ) is a consistent stochastic utility. 

— If v is an exponential utility it suffices to take Z and N satisfy 

^ N = r + a N .r ] °, ii z = l\\r,°-o- N <° + o- Z '°\\ 2 , a N 

so that U(t,x) = Ztv(x/Nt) is a consistent stochastic utility. 

This result gives sufficient conditions under which U, defined above, is an ^"-consistent stochas- 
tic utility. Note also that this example generalizes the one in [33] in which case u is an exponential 
utility and provides a simillar sufficient condition. 
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Proof. To facilitate the exposition, let us denote by r = r — fi N + a N .rf , f] = rf — cr N . The 
volatility vector 7 being given by equation (|16p . Lemma 12.31 gives the optimal policy k* 

= -^ r (-xU xx (t,x)a^ a + U x (t,x)(fi1 + af' a )). (17) 

3j 7**7; ^ ' 



Then, the drift of the utility process U satisfies the HJB constraint (|13p if and only if, 

TT Z , TT - TT N,± I - 1 Z\ {Ux) ||*(T , Z.CT 1 1 2 . X U xx jy I ||2 / s „ 

Un t +U x r t x-xU x a > .{vt + o- t )-^j—\\rj t +a t ' \\ +__|| (7t > || (i >a ;) = 0. 

Using that U(t,x) = Ztv[x/Nt) and simplifying by xv(x)Z, it follows from the definition of ?) 
and f that Vt > 0, x > 

V Z , TV , TV <r N.± Z,± v x ii^o- #,<7ii2 , /i , TV,±||2/. \ n Cio\ 

IH+rt-Ht +cr t .rj t -a t ' .a t > -- ||r? t +a t \\ + — || (t,x) = 0. (18) 

The case: v/xv x and v x /xv xx are proportional, in turn d is a power or exponential utility. 

• v(x) = x a /a. Then equation f)18|) becomes, Vi > 

1 Z . TV i TV <r N,± Z,± . 1 II a N,u . Z,o\\1 . 1 + a n AT,_L M 2 n 

-Ht +r t -(J> t +°t -Vt -<?t -°t + 2 / x _ s \\Vt ~°t +°t II H 2 — '1°"* I' 

• v ( x ) = -\e~ cx , c> 0. Then Vt > 0, x > 0, 

Z 1 I. cr TV,cr . Z,cr u 2 ( AT , TV ct TV,_L Z,±\ . / ca;2 \ii TV,± M 2 n 

M - g 11^ - °t + °t II - C3 \ r * — A*t + a t -Vt -tr t ' -or t ' ) + (— - cx)||a t || =0. 

Obviously, this is a second order polynomial identically null, consequently all coefficients are 
nulls, i.e., r = r - fi N + a N .r] a = 0, fi z = ±||7? CT - a N ' a + cr z > a \\ 2 , a € Vf 
Second case : v/xv' and v'/xv" are not proportional, then it is immediate that all terms of 
()18p are equal to zero, in turn r = 0, \i = 0, <r G 7£ CT , 77^ — cr^ + G 7£ CT '^ and hence the 
optimal strategy k* in (|17p is simply a . 

To summarize the situation: Z is a martingale, X K /N is a martingale under the probability 
defined by dQ z /cflP = Z and a N £ K a . 

□ 



As in the classical theory of optimal choice of portfolio in expected utility framework ([ 
|40j). the process (U x (t,X£)} has nice properties and a central place in the dual problem in- 
troduced in the next section. For notational simplicity in the next result we do not recall the 
dependence of the optimal wealth relative to its intial condition x contrary to Section [3] where 
it plays a very important role.. 
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Proposition 2.6. Let U be a progressive utility of class in the sense of Kunita, with local 
characteristics (/3,7). Assume that all assumptions of Theorem \2.J\ hold true, in particular that 
X* is a solution of dX; = X* t [r t dt + K* t (X?).(dW t + rffdt)] . 

Let L* be the stochastic diffusion operator ofX*, L^ x = (x)\\ 2 -^j+{rtx+(xK,l(x)).r]^ }-*%:■ 

i) Then, U x is of class in the sense of Kunita with local characteristics ((3 x ,j x ) and 

f J x (t,x) + U xx (t,x)(xK* t (x)) = -U x (t,x)r)% + J x (t,x) 
[ (3 x (t,x) = -U x (t,x)r t - L* t x U x (t,x) - (xK*(x)).j xx (t,x) 

ii) The semimartingale U x (t,X£) has the following dynamics 

dU x (t,X* t ) = U x (t,X* t )[- r t dt + (vY tX (X*) - nt))-dW t ] (19) 

In particular, for any admissible wealth process X K (k € TZ a ), (X£ U x (t,X£)) is a local martin- 
gale and a martingale if X K = X* . 

This result shows that U x (t,X^) plays the role of a state price density process, defined in 
Definition 13.11 

Proof Theorem l2.1l shows that U x is of class in the sense of Kunita, with local characteristics 
(f3 x , 7a;). On the other hand, by Theorem 12. 4| we have the identities /3(t,x) = —xU x (t,x)rt + 
\x 2 U xx (t, x) \\kI {x)\\ 2 and U xx (t, x)(xk^(x)) = — (U x (t,x)r}1 + j^(t,x)^ . This second identity 
is useful to calculate \U xx (t, x)d x ( \\xk^(x)\\ 2 ) = U xx (t,x)((xK* (x)).d x (xK*(x))) . Taking the 
derivative with respect to x in this second identity, it follows that 

U xxx (t,x)(xK* t {x)) + U xx {t,x)d x (xK* t (x)) = -(U xx {t,x)r% + lfc x (t,x)). 

In fact we are interested in the inner product with the vector xk*(x) that yields the following 
equality written in an appropriate form 

]jU xxx (t,x)\\xK* t {x)\\ 2 + U xx (t,x){(xK* t {x)).d x (xK* t {x))) 
= -{\u xxx (t,x)\\xKl{x)\\ 2 + U xx {t,x)n°^^^^ 

It is easy to recognize the first line as the derivative of \U xx {t, (x)|| 2 and the second 

line as related to the diffusion operator L\ x . In this form the relation (3 x (t,x) = —U x (t,x)rt — 
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L*U x (t,x) — (xK*(x)).'y xx (t,x) is easy to establish. 

We have now all the elements needed to calculate the dynamics of U x (t,X^) using Ito-Ventzel 
formula 

du x (t, x* ) = ( lx (t, x* ) + u xx (t, x* t )x* t 4 (x*)) .dw t 

+ {p x (t,Xt) + L*U x (t,X*) + lxx (t,Xt).(X*K* t (X^))}dt. 

Note that in the last inner product, we can replace "f xx (t,X^) by its orthogonal projection 
J xx {t,X^) on the space 1Z° . Thanks to the previous calculation, the expression in the brackets 
of the second line is exactly —rtU x (t, X^). The diffusion coefficient may also be simplified into 
—U x (t,Xt)r]1 + 7^(t,X^). So, we obtain the remarkably simple dynamics of U x (t,X£) 

dU x (t, xt) = U x (t, X* t )[- r t dt + {rg>\xt) - 4)-dW t ] . 

Let us now prove the last sentence. Given an admissible wealth process, dXf = X£ {rtdt + 
K t (dWt + rftdt)), standard Ito's calculus provides an explicit form for the dynamics of Z* = 
X?U x (t,X?) as 

dz? dx? du x (t,x*) djq du x {t,x*) 
z? x? u x (t,x t *) x?'u x (t,xt) 

= [ Kt -rg + T g> 1 (x;)].dWt, 

which implies that Z t K = XfUxit, X£) is a local martingale for any k £ lZ a . In particular the 
volatility coefficient of Z* is a t ' : = {k\ {XI) - rf t + rjt' (X t *)). To show that the positive local 
martingale Z* is a martingale, we use the concavity of the utility U, with the fact that U(0) = 0. 
As consequence, Z£ = X*U x (t, X*) < U(t,X*); since by assumption U{.,X*) is a martingale, 
the same property is true for Z*. This completes the proof. □ 

3 Duality 

After having introduced the consistent stochastic utilities and established the associated SPDEs, 
several questions remain open at this stage. Indeed, we have shown that the volatility 7 of 
these utilities plays a fundamental role since it completely describes the stochastic dynamics of 
utilities and the optimal policy. It now remains to give an interpretation of the orthogonal part 
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7^"- The classical theory leads naturally to introduce the convex conjugate function U(t,y) = 
inf x> o ia ; g Q+ (U(t,x) — xy) (also called the Legendre-Fenchel transform) of U(t,x). 

We want to show that this conjugate random field is a solution of a dual utility SPDE, 
consistent with a convex family y of semimartingales called density processes parametrised by 
their so-called risk premium v 1 - . Then the optimal risk premium v '* is related to n u, - L = j^r/U x . 

In the classical theory of concave functions / and their conjugates /, the monotone functions 
f x and —f y are inverse of each other, i.e. —fy(y) = / 2 T 1 (?/)i i n the stochastic framework, 
monotone functions are replaced by stochastic monotone flows and their inverse flows whose 
dynamics are given by the Ito-Ventzel formula. For simplicity, we present these results separately 
and in an appropriate form. 

3.1 Local characteristics of inverse flows 

Let 4> and ip be two one-dimensional stochastic flows, with dynamics 

d(f>(t, x) = //(i, x)dt + er^i, x).dW t , 
dip(t,x) = ^(t,x)dt + a^{t,x).dW t . 

From Ito-Ventzel's formula, under regularity assumptions, the compound random field (ft o 
ijj(t,x) = (j)(t,ip{t,x)) is a semimartingale whose characteristics are given explicitly from those 
of 4> and ip and their derivatives. 

Theorem 3.1. Suppose that <ft is a regular random field in the sense of Kunita, and t/j(t,x) 
is a continuous semimartingale. Then the random field <po tp (t,x) = (fi(t,ip(t,x)) is a continuous 
semimartingale with decomposition 

d(<f>oi/;)(t,x) = fJ,' i, (t,ip(t,x))dt + o-' t '(t,ip(t,x)).dWt 

+ cj> x (t, i/j(t, x)) di/}(t, x) + -<j> xx (t, y>(t, X)) | \(T* (i, X) | \ 2 dt 

+ a^(t,ip(t,x)).a' ll '(t,x)dt. (20) 
The volatility of the compound process <fio ip is given by 

o*°*(t,x) = a*(t,^(t,x)) +4> x (t^(t,x))a^(t,x). 
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The next proposition, used several times throughout this paper, gives the decomposition of the 
inverse of a strictly monotone stochastic flow. 

Proposition 3.2 (Inverse flow dynamics). Let (p be a strictly monotone flow, regular in the 
sense of Kunita, with characteristics (/j,^(t,x),a^(t,x)). The inverse process £ of (ft is defined 
on the range of 4> by = y- 

i) The inverse flow £(t,y) has a dynamics given in terms of the old variables by: 

dt(t,y) = -£ y (t,y){^(t,Odt + o-^t,0.dW t ) + ^d y (^ y (t,y)\\^(t,Ot)dt 

ii) With the new variables, using that a^(t,y) = —^ y {t,y)cr^(t,^(t : y)) 

d£{t,y) =o-Z(t,y).dW t + (I^(^-M^) -^(t,at,ym y (t,y))dt 

It is interesting to observe that the local characteristics of the inverse flow £ can be easily 
interpreted as some derivatives. This point will play a crucial role in the sequel. The mathe- 
matical formulation of this remark is given in the following corollary, where the assumptions of 
Proposition 13.21 are made. 

Corollary 3.3. Let (<&(t, x), M^(t, x), x)) be the primitives, null at x = 0, of 4>(t,x), 
(fi^(t,x),a^(t,x)) respectively, so that the $>(t,x) dynamics isd&(t,x) = M^(t,x)dt+Y^(t,x).dWt- 
Then, the dynamics of the random field 2(t, y) = j^°°^(t,z)dz is 

• In old variables, 

dE(t, y) = E% e(t, y)) AW t + (t, £(i, y))dt + ±Z yy (t, y)p% (t, £(t, y)) fdt 

• In new variables, with the notations M^(t, y) = M^(t, —3 y (t, y)) and y) = — £^(i, —E y (t 

dE(t,y) = &(t,y).dW t + (M%y) + iM^^W (21) 

V 2 z> yy {t,y) J 

Remark . Note that if the process 4> i- s strictly increasing on x then its primitive $ is a 
progressive utility (concave increasing random field) with a convex conjugate random field S 
satisfying (I2ip . Moreover, for a particular choice of the drift M* (HJB type), <& is a consistent 
utility and the dynamics (I2ip gives the dual SPDE. 
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Proof. The proof of Proposition 13.21 is essentially based on the generalized Ito's formula es- 
tablished in the Appendix. For simplicity, we denote by the local characteristic of £ 
assumed to be regular. By Ito-Ventzel's formula, we have 

d<f>(t,£(t,y)) = 

= fi*(t, at, y))dt + o*{t, y)).dW t + Mt, t(t, y)H(t, y) 
+ -&»(*,£(*,!/)) < d£(t,y) > +4(t,Z(t,y)).aS(t,y)dt 



Recalling the following identities 



<l>x(t,€(t,y)) = , 4> xx (t,£,(t,y)) 



we can express the parameters of the decomposition in terms of £, and ^ and the diffusion 
coefficient a^(t,y) of £, since a^(t,y) = —^ y (t,y)a^(t,^(t,y)). It is immediate that 

= -C(i,y)/(t,e(t,y))+^(i,y) < ^(t,^t,y)),a}(t,^t,y)) > +\t yy (t, y)\\o*(t, £(t, y))\\ 2 

In terms of the stochastic random fields and cj^, this may be written as 

^(t, y) = -C y (t, y)^(t, ^(t, y)) + \d y [t v (t, y)\\*+(t, ^(t, V)) II 2 ] • 

In terms of their own parameters, it follows from the strict monotonicity of £ that 

^{t, y) = -C y (t, y)^(t, C(t, y)) + \d y [\\ot(t, y)\\ 2 /a(t, y)] ■ 
The proof of Proposition 13.21 is now complete. 

The proof of Corollarv l3.3l is achieved, first by reconciling the results of the previous proposition 
and the following identities, 

{<5> x )-\t,y) = -Z y {t,y), & xx (t,-Ey(t,y)) = - - ) , and - C x (t, -E y (t, y)) = £ v j! V \ 
and second by integrating with respect to y, using the initial condition E(i, 0) = 0. □ 

3.2 Convex conjugate of consistent stochastic utility and dual 
utility SPDE's 

In this paragraph, properties and dynamics of the convex conjugate U of a consistent stochastic 
utility U are investigated. In particular we show that if the drift (3 of the utility U is of HJB type 
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(equation (fT3|) ). then the drift of the convex conjugate U denoted by j3 is also of HJB type and 
conversely. This property implies that the random field U is a progressive convex conjugate ran- 
dom field, consistent with a familly of state price density processes, introduced below. We apply 
the results of the previous paragraph to the stochastic flow (U x (t, x)) and its inverse (—U y (t, y)) . 

The formula of inverse flows yields easily the dynamics of U(t, y) from the dynamics of 
U(t,x). Based on Proposition 13.21 and Corollary 13.31 we derive a stochastic partial differential 
equation whose convex conjugate process U(t, y) is a solution. 



Proposition 3.4. Let U be a consistent progressive utility of class in the sense of Kunita, 
with risk tolerance a^{t,x) = —jj^jf-^ ^nd utility risk premium r) U (t,x) = • Assume 

that U satisfies the utility SPDE with the f3 constraint i!3\). Let U be its dual convex conjugate, 
null if y = +oo. Then, 



(i-a) In old variables, U satisfies dU(t,y) = fi l {t, —U y (t,y))dt + j(t, —U y (t,y)).dW t , where 



U(t ) (22) 
ff.(f,s)( - xr t - £L^(||^ (a .) + _ ||^(x)|| 2 )) 



(i-b) In new variables, 



P(t,y)=f3 1 (t,-U y (t,y)), 7(t,y)=<y(t,-U v (t,y)), %{t,y) = -yU yy (t,y) V u (t,-U y (t,y)) 

Rt,y) = yU y (t,y)r t + ] A \\%(t,y)f - \\%{t,y) + yU yy {t,y)^f) 

2U yy {t,y) 

(ii) Optimization Programs: The drift /3 1 (t,x) and /3(t,y) are the value of two optimization 
programs achieved, respectively, at the optimal policies 6*{t,x) = rff'^ix) and y^{y) = 
9*(t,-U(t,y)) = -^(t,y)/yU yy (t,y). 



f3\t,x) = U x (t,x)\- xr t ~ ^oF{t,x){ inf \\9 t - {rf t + rj? (x)) || 2 - ||r#(*)|| 2 ) 



P(t,y) = yU y (t,y)r t --y 2 U yy (t,y) inf {\\u t - r£\\ 2 + 2(v t - 



ly(t,y) 
yU yy (t,y) 



)> 



(23) 
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First, observe that as — U y is the inverse flow of U x , the dynamic of the convex conjugate U of 
U becomes a simple consequence of Corollary 13.31 Second, the orthogonal part of the utility 
risk premium r) > := t~ fU x is the optimal policy of the dual problem in (ii). Third, given 
that (3 is associated with an optimization program the dual drift /3, it is also constrained by a 
HJB type relation in the new variables, which means that the convex conjugate U is consistent 
with some given family of the state density processes. 

Proof. By regularity assumptions, using Theorem 12.11 U x (t,x), /3 x (t,x) and ^y x (t,x) are regular 
enough to apply Ito-Ventzel formula. The assumptions of Proposition 13.21 and Corollary 13.31 are 
satisfied and hence the dynamics of the convex conjugate is a direct consequence of Corollary 
13.31 Let us now recall that the drift f3(t,x) of U(t,x) is given in Theorem 12.41 by 

f3(t, x) = U x (t,x){- xr t - I \rj?* (x) +v?\\ 2 )- 

Combining this identity with Definitions of the random fields oF and r] U yields (|22p . In other 
hand, the formula for /3 1 (t, x) in (|23|) is a consequence of the following property of the orthogonal 
projection: the norm of the projection on lZ a is the distance to the orthogonal vector space 
TZ 17 ' 1 - . So, for any vector a € R N , ||a CT || 2 = inf^g-^x \\u — a\\ 2 . Replacing a by (rfc + rff' a (x)) 
yields the result. 

Now, we focus on the drift f3 of U(t, y) in new variables, using essentially the following identities, 

U*(t,-U y _(t,y)) 1 2 - ^ MlVl = _ lx{t ^u y ^y)l -M^L = - V V(-U y (t,y)) 

2U xx (t,-U y (t,y)) 2 U yy (t,y) yUyy(t,y) 

We get the desired formula for (3 in (|23|h 

Kt,y)=yUy{t,y)r t - l -y 2 U y y{t,y) inf {[ \u t + rg\ [ 2 + 2{v t - rg) ■ ( )} 

2 ^ yUyy{t,y) 

On the other hand by orthogonal projection on 7^-^'" L and using the fact that rfc € TZ" , there 
exists one and only one optimal process v* given by 

u t ( y > = t~t u \ = (~U y (t, y)) 

yUyy(t,y) 

By the same argument we get 6*(t,x) = ^'^(x). Which achieves the proof. □ 
Let us now focus on the dual optimization problem. 
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Definition 3.1 (State price density process). A ltd semimartingale Y u is called a state price 
density process if for any wealth process X K , k S 1Z a , Y V X K is a local martingale. It follows 
that Y v satisfies, 

dY v 

-^ = -r t dt + (y t -4).dW u u t en a ^. (24) 
Y t 

& is the family of all state density processes & := {Y u , v £ lZ a ^ , Y u satisfies \24\) } 
Obviously the class is not empty, since taking v •= 0, Y° is the classical minimal density 
process where the pricing of future cash-flow at time T is obtained by first discounting between 
t and T the cash value at T with the short rate r t , and then by taking the conditional expected 
value with respect to the minimal martingale measure. Moreover, any state density process Y v 
is the product of Y° by the density martingale L v t = exp ( JjJ v s .dW s — 1/2 J* |zA,| 2 <i,s). 

We obtain an interesting interpretation of the volatility risk premium in terms of optimal density 
process. 

Let now, turn to the main result of this section which is based on the interpretation of the 
drift f3 as an optimization program. 

Theorem 3.5. Let U be a consistent progressive utility of class in the sense of Kunita, 

satisfying the f3 HJB constraint. Then, its conjugate process U(t, y) (convex decreasing stochastic 
flow) is consistent with the family of state density processes & , in the following sense: 
U{t,Y v ) is a submartingale for any Y v £ <3/ , and a martingale for some process Y v (:= Y*). 
The optimal process can be chosen as Y t *(y) = U x (t, X£ (— u y (y))) , whose dynamics is 

rlY* 

_± r = - rtdt+ tf(Y*)-V?)-dW t . 
where the dual optimal parameter ^ (y) is given by 

yu yy {t,y) y 

Remark . Let y(t,x) := U x (t,X^(x)), if X^(x) is strictly monotone in x, by taking its inverse 
X(t,x), we can obtain U x (t,x) in terms ofy(t,x) and X{t,x). 

Proof. The first assertion of this result is essentially obtained by analogy with the primal prob- 
lem. Indeed, using the $ expression's ([2"5]) . which is 

p(t,y)=yUy(t,y)r t + \y 2 Uyy(t,y) sup {- 1 \u t - rf t \ \ 2 - 2{u t - tf) ■ ( if'^ - ) } 

1 utew- 1 - yUyy{t,y) 
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One can easily remark, by analogy to expression of Q in Lemma 12.31 and that of /3 (equation 
(|13p . Theorem 12. 4p . that U is consistent with the family of processes W, that is U(t,Y t v ) is a 
submartingale for any y v € and a local martingale for the optimal choice (Theorem 13. 4p 
v t{v) = ~ ly{t, y)/yU yy (t, y) = 7^(i, —U(t,y)) /y, if there exists a solution to the SDE, 

dY u * 

-r t dt+{r, u ^{t,-U y {t,Yf))-if t ).dW t . (25) 
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On the other hand we recall that according to Proposition 12.61 assertion ii) U x (t,X^) satisfies 



dU x (t,XZ) 
U x (t,X*) 



r t dt+( V ^(X:)-r,Z).dWt, 



Note that Y t *(y) = \ U x (t,X$(-u y (y)))) and that -U y (t,Y t *(y)) = X?(-u y (y)) shows that 
that Y * is a solution of (|25p which in turn implies the optimality of Y * . 

To conclude, we have to show that U(Y t *(y)) is not only a local martingale but a "true" mar- 
tingale, when U(Xt(x)) is a martingale. Put x y = —u y (y), and use that the conjugacy relation 
implies that U{Y t *(y)) = U(X?(x y )) - Y t *(y)X?(x y ) with Y t *(y) = (U x (t,Xf(x y )). Thanks to 
Proposition 12.61 U(X^(x y )) and Y t *(y)X*(x y ) and therefore U(Y t *(y)) are martingales. □ 

Decreasing Consistent Utilities An interesting class of consistent utilities is the class 
of decreasing consistent utilities, which was studied and fully characterized in the literature by 
Berrier & al. [TO] and Musiela & al. [35]. The utilities have a volatility vector 7 identically 
zero. It is an example where the dual SPDE is easier to study than the primal one. Indeed, 
taking 7 = 0, U is a solution of a non linear SPDE 

where the convex conjugate U satisfies 

dU(t,y) = [-^y 2 Uyy(t,y)M\\ 2 + r t yU y (t,y)]dt 

Writing that = U t (t,y) yields 

Ut^yXiv) = -iy 2 C/ ra (t,y)( W )||^HI! 2 + n(^)y[/ y (t,y)H 

which implies, by convexity, that t 1— > U(t,y) is a decreasing function. Moreover, it is easy to 
recognize in this PDE that the right hand side of the equation is nothing other than the operator 
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of diffusion of a geometrical Brownian motion with coefficients t${oj) and —rt(co) Lfy{oj) applied 
to U: U t (t,y)(uj) = —LtyU(t,y)(uS). From this point, the idea is to look for positive solutions 
which are space-time harmonic functions of a geometric Brownian motion. As in Musiela & al 
and Berrier & al, the function U(t, y) is assumed to be of class C 3 in y and of class C 1 in time. 
First, put V(t, y) = U (t, e~ fo r ' sds y) and A(t) = Jq \\rj" \\ 2 ds; then V is a solution of the following 
PDE 

V t (t,y) = ~A t (t)y 2 V yy (t,y). 

Second, define H(log(y) — \A t , ^A t ,ui) = —V t ,y(t, y, oo) and take the change of variable r = \A t , 
it is straightforward to check that H solves the backward heat equation, 

H t (t, z) + H zz {t, z) = 

The solutions of such equation are called space-time harmonic functions. Since the function H 
is strictly positive, using the result of Widder, D.V \A2>\ I44j . F. Berrier & al. [10] and Musiela 
& al. [35j show the following result which characterizes all decreasing consistent utilities 

Theorem 3.6. Let U(t,x) be a regular random field of class C 3 on x such that ^^U{t,y) = 
-^0^U{t,y) is defined and continuous. Assume U satisfies the utility SPDE with 7 = a.s.. 
Then U is a consistent stochastic utility if and only if there exists a constant C*£K and a finite 
Borel measure m, supported on the interval (0, +00) with everywhere finite Laplace transform, 
such that 

U(t,y) = [ ^ T (l- y 1 -^ e - i Sr/olfell 2 ^)dm(Q) + C. 
Jm.* + 1 - „ 

U y {0,y) = - y~*dm(a) 

Moreover the optimal wealth process is strictly increasing and regular with respect to its initial 
condition x. 

There is an interesting interpretation of these stochastic utilities: at date t = the derivative 
U y (0, y) = u y (y) cqscccan be easily interpreted as the integral —y~~ weighted by the measure m, 
which is nothing than the derivative of the convex conjugate of power utility with risk aversion 
a. Hence, one can imagine that the investor starts from a power utility and pulls at random the 
risk aversion a. At time 0, his dual utility is a mixture of power dual utilities weighted by some 
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measure m, and at time t, the same property is preserved but the measure becomes stochastic 
with density with respect to m, nit(da) := e~~2^^o " ??s " ds dm(a). 

The stochastic measure mt(da) is the unique one which ensure that the process U constructed 
is the conjguate of a consistent utility. This interpretation is the starting point of the work [22] 
where more general method to construct consistent utilities processes from a family of classical 
utilities functions is developed. 

3.3 Change of numeraire 

One of our first reasons of interest in progressive utilities was the fact they are consistent 
with classical transformation in financial market in contrast to the classical utilities functions 
which are not stable by change of numeraire; so, the value function of the classical portfolio 
optimization problem is highly dependent on market parameters (r, rj). Moreover, it is easier 
to work with portfolios that are local martingales rather than semimartingales, that can be 
obtained using the market numeraire and there is a genuine interest to provide details of this 
transformation on consistent stochastic utilities. 

Let's start with the following general result which is a direct consequence of the definition 
11.11 In a more specific market: the bownien market which is the framework of this paper we 
can say more about the properties of these utilities in particular we can study the dynamics of 
these random fields as we see in next results. 

Proposition 3.7 (Stability by change of numeraire ). 

Let U(t,x) be a -consistent stochastic utility, N be a positive semimartingale and denote by 
J3t the class of process defined by 3C = {X := X/N, X £ 3£}, then the process V defined by 

V{t,x) = U(t,xN t ) 

is a -consistent stochastic utility in the market of numeraire N if and only if U is an In- 
consistent stochastic utility. Moreover, the optimal wealth processes are related by the following 
identity: X* = X*/N. 

Roughly speaking the proposition says that the notion of ^-consistent utilities is preserved 
by change of numeraire. If the agent decides to invest in a secondary market (foreign market) 
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his preferences (risk aversion) are still unchanged, given the uniqueness representation of his 
preferences. 

To show this result it is enough to verify the assertions of Definition 11.11 using identity V(t, Xt) = 
U(t, Xt) and the fact that by definition the optimal wealth processes are related by X* = X* /N. 
Now, we turn to more quantitative aspects of the change of numeraire. In the brownien market, 
the idea is to show how, by change of numeraire techniques, we simplify the utility SPDE's 
of consistent stochastic utilities. The local characteristics of the new stochastic utility V are 
obtained by applying Ito-Ventzel Lemma and the parameters of the new iV-market. 

Assumption 3.1. The new numeraire N , is assumed to satisfy: 

The wealth process X is defined by Xt := Xt/Nt where X denotes the wealth process in the 
initial market. By Ito's formula, we can easily write the dynamics of X K = X*/Nt, 



dX?{x) 



[n - $ + 5?<°.T£)dt + ( Kt - 8?).(dW t + (tf - 6?)dt), 



x 



X?{x) 

Denoting f = r — fi N + 5 N ' a .r] cr the short interest rate in the new market and by f\ = rf — 5 N 
{fj a = rf — 5 ,cr ) the new market price of risk, we get 

= f t dt + (nt - 5?) . (dW t + rkdt) , K t G 72f . 

X£{x) 

Let us now stress that if 5 N € Vf the volatility vector k = k — 5 of X belongs to lZ a . Hence 
we get that a consistent utility V in this new market satisfies the same dynamics as U in the 
initial market only by replacing r, rj by r, fj. 

Else if 5 N,1 ~ ^ the optimization problem is quite different and utility-SPDE is modified, as we 
will see in the following result. 

Theorem 3.8. Let U(t,x) be a 3£ -consistent stochastic utility satisfying the assumptions of 
Theorem \2.J\ The ^-consistent stochastic utility V(t,x) := U(t,xNt) is a solution of the 
following stochastic partial differential equation 

dV(t,x) = r^) (| 1 1 22 — I l^ , --l-^^ ; - L — a^or^^^— 1 1 22 ) — a^^* } C* , a=) C* » a=r)-rfl^i 



29 



with a (t, x) := V x (t, x) /V xx (t, x) and r) (i, x) = 7 (t, rc)/^^, x) denote the risk tolerance and 
the utility risk premium of V . The volatility of V is 7 (t,x) = j u (t,xN t ) + xV x (t,x)8^ and 
the optimal policy k* is given by 



Let us comment on the content of this theorem and its relation to the previous results. The 
dynamic (|26p of consistent utilities and the optimal policy (j26[) are more complicated then the 
ones in the initial framework. We recognize in the optimal policy formula a first term (very 
similar to that of the initial market) which corresponds to an optimization program without 8 N 
added to a second one which correspond to a translation by 8 . This is due to the fact that 
the dynamic of new wealth processes are a kind of combination of the initial market and the 
dynamics of the state price density processes in the dual problem studied in previous section. 
According to Remark 12.11 which generalizes Lemma 12.31 and due to the fact that volatilities 
of new wealth processes X are translated by the vector —8 N , the optimal policy in this new 
market, denoted by k is given by 



On the other hand, it suffices to take 8 in the range of the matrix a, to get the SPDE's of the 
old market and to take 7) = to get SPDE similar to the dual HJB-SPDE. 

Martingale market Now, remark that there exists a market numeraire portfolio X% = 
£ X also called growth optimal portfolio see E. Platen and D. Heath [36] , which trans- 
forms the classical wealth processes into positive local martingales, by translating the space of 
constraints 1Z° . When using any state price density process Y u and the associated numeraire 
N% = ', the local martingale property holds true, but the space of constraints is modified. 

Corollary 3.9. Under same assumptions as Theorem \3.8l taking N equal to the numeraire 
portfolio 1/Y°, the market has no risk premium and the ratio rj ,a has the same impact as a 
risk premium, but depending on the level of the wealth x at time t. In particular, the previous 
dynamic of V is simpler 




(26) 




dV(t,x) 



(V x ) 2 (t,x) rt' a (t,x) 
2V xx (t,x) 11 V x (t,x) 



dt + Y(t,x).dW t . 
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and the convex conjugate VofV satisfies 



dV(t,y) 



1 



\mt, V )\\ 



2 dt + j v {t,y).dW t . 



2Vyy(t,y) 



Where the optimal policies are given by: 



xk* t {x) 



a 



V (t,x) 



l V ' a {t,x) 

V X X (t) 3-) 



Uyy(t,y) 



In this result, taking a numeraire with good properties the HJB-SPDE is simplified and 
become more intuitive. The utility process is a supermartingale and its dual conjugate is 
a submartingale. Moreover, the optimal policies are only characterized and driven by the 
derivative of the volatility vector. 

We end this section, by the following corollary which is a consequence of the above result. 

Corollary 3.10. Under the assumptions of Theorem \3.8l taking N = Y° , we have 

• 7^ £ TZ a implies that V is a local martingale and the optimal dual process is constant: 
Y* = 1. 

• j v € TZ a,1 ~ implies that V is a local martingale and the optimal wealth X*(x) = x. 

The new market defined from the first one by change of numeraire (the market numeraire) 
is called a martingale market because new wealths are local martingales. 



4 Utility Characterization and Stochastic Flows 
Method for Solving Utility-Stochastic PDE's 



As it is mentioned earlier, conventional methods of resolution of SPEs defined from their terminal 
conditions, such as the method of characteristics, can not be used to solve utility SPDEs. To 
overcome this difficulty, we present here a new approach for these utility stochastic partial 
differential equations, based on a random change of variable. This new approach, that we call 
"stochastic flows method", is based on the properties of the optimal wealth X* and the state 
price density process Y*, both supposed to be a monotonic function of their initial condition. 
More precisely, we take the initial condition U(0, .) = n(.) and an admissible wealth process 
as given, and ask: what are the conditions on these data to be an optimal wealth process of 
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some consistent stochastic utility U, and also how to recover U from this information? In the 
classical expected utility framework, this is the question that He and Huang [12] asked in (1992) 
in a complete market. From one point of view, our problem is easier to solve because we allow 
ourselves a larger class of utility functions. In particular, we establish in the following that the 
only restriction is the monotony of the wealth process with respect to the initial wealth, plus 
some integrability condition. Another difference between this work and that of He and Huang 
|12j is that we work directly on the path of wealth process while they work with the volatility 
of the wealth process n(t,x) = n(t, St,x) in their setup. 

Before presenting this new method, remember that the direct analysis gives us a natural way 
of finding U from the inputs (u, Y*,X*) : Let U be a consistent utility with optimal wealth X* 
then, according to Theorem 13.51 and Proposition 12. 6} the process Y* defined by Y t *(u x (x)) = 
U x (t,X£(x)) is optimal for the dual problem and such that Y*X* is a martingale. So, if 
X* is strictly increasing with respect to the initial capital, with inverse flow X, U x (t,x) = 
Y t *(u x (X(t,x))); integrating with respect to x we get U. 

From this we assume for the rest of the paper the following main assumption. 

Assumption 4.1. The wealth process X£(x) is assumed to be continuous and increasing in x 
from to +oo with X£(0) = 0, X 4 *(+oo) = +oo for any t and satisfies 

dX* (x) 

v t) ' = r t dt + K* t (X*(x)).(dW t + rgdt), k$(x) € 72£, Vx > 0, a.s. 
X t (x) 

Denote by X(t, z) the inverse flow such that X*(X(t, z))) = z. 

Financially speaking this hypothesis, which may be a consequence of a no arbitrage op- 
portunity, says that: we do not invest more to earn less. On the other hand, this monotony 
assumption is true in many examples and, according to the classical results of stochastic differ- 
ential equations (SDE), is satisfied as soon as xk^(x) is locally uniformly Lipschitz, (see Kunita 
[25]). 

Note also, by conjugacy identity, that monotonicity of X*(x) implies that the dual process 
Y*(y) is, in turn, strictly increasing and therefore invertible with respect to its initial condition 
y for any date t. The converse property is also true. Consequently, we also have the following 
hypothesis. 
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Assumption 4.2. Y t *(y) is continuous and increasing in y from +00 to satisfying 
dY*(y) 



Y t *(y) 



-r t dt + {^(Yt(v)) ~ Vt)-dW u v*{y) G K^, Vy > 0, a.s. (27) 



Starting from the idea above, Assumptions 14.11 and 14.21 allow us to compose X* with the 
inverse of Y* and Y* with the inverse flow of X*. Under some additional regularity assumptions, 
we establish one of our main contribution that involves the characterization of any consistent 
utilities generating X* as an optimal portfolio. In particular, we give the decomposition of the 
derivative 7 of the volatility vector as an operator of U x and U xx given k* . The second main 
result of this paper introduce a new method to solve the utility stochastic PDE. The idea is 
to transform the SPDE in a system of two stochastic differential equations (SDE). Herein, the 
method proposed can be used for a large class of SPDE. 

There are two different messages in our approach hence we decide to present the associated 
results separately. Note that the results of this sections can be obtained first on the martingale 
market and, simply, by using the results of Theorem 13.71 we get simillar ones on the initial 
market. 



4.1 Utility Characterization from optimal wealth and state den- 
sity processes 

To fix the idea we consider a given wealth process X*, a state density price process Y* and 
an utility function u(x). The objective is to construct a consistent utility U starting from 
the function u{x) (U(0,x) = u(x)), generating X* as optimal wealth and Y* as optimal dual 
process. According to the necessary analysis above, the constructed utility process satisfies 
U x (.,X*(x)) = Y*(u x (x)). 

Remark . Before continuing our investigations it is important to note that the duality is not 
needed in what follows. By Proposition ^. 6\ assertion ii), U x (., X* (x)) is a density price process, 
which is sufficient to present our new approach. 

Linear optimal state density process. To illustrate our approach we first start by 
proving this result in a special case where we assume that the process Y*(y) = yY° since 
v* = a.s. The advantage of this case is that we can find all messages of our construction 
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and a complete overview of the main calculations. This will better the understanding of the 
calculations that are made in the general case, because they are more difficult to follow, although 
not really more complicated. 

Assuming Y*(y) = yY°, the identity Y*{y) = U x (t, X* (—u y (y)) (Theorem I3.5|) suggests a 
very simple way to associate a progressive utility U(t,x) with the wealth process X* . Indeed, 
if X(t,z) is the inverse flow of X£(x), then the increasing process U(t,x) satisfying U x (t,x) = 
u x (X(t,x))Y® is a good candidate to be a consistent stochastic utility. Another remarkable 
property of this random field is that U x (t, X*(x)) = U x (0, x)Y t °, which is another way to express 
that the optimal dual policy v* is null. We are then ready to state one of the important results 
of this section. 

Theorem 4.1. In addition to the monotony assumption \4-l[ assume that the given admissible 
portfolio (X^(x)) has a volatility k^(X^), where the process k^(x), is sufficiently regular to make 
the process X^{x) a regular in the sense of Kunita. In addition, we assume that (Y^X^(x)] 
is a martingale Vx > 0. Recall that X is the inverse flow of X. 

Let u be a utility function such that x i— > u xx (x)X^(x) is integrable near to infinity. Then we 
define the processes U and U by, 

U(t,x)=Y t ° u x (X(t,z))dz, U(t,y) = J X* t (-u y (^))dz. (28) 

U is a progressive utility, whose convex conjugate is U , and satisfies the dynamics 

{ dU(t,x) = ( - U(t,x)r t + 2U J [t , x) \h x (t,x) + U x (t,x)rfi\f)dt + 7(t,x).dWt 
{ nf x (t,x) = -U xx (t,x)xK* t (x) - U x {t,x)rfi 

U(t,yY^) and U(t,X£) are martingale processes and U is a X -consistent stochastic utility, 
with optimal wealth X*. 

Note the fact that the state price density process Y*(y) = yY° is linear with respect to its 
initial condition greatly simplify this first result (true if v* is not depending on y) contrary to 
the next theorem where v% is a function of y. 

Proof. First by definition U is strictly increasing concave random field and of class in the 
sense of Kunita. Let us now focus on the dynamics of this progressive utility. Any thing is 
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simpler in a martingale market, when is replaced by 1, but the PDEs are a little more 
complicated. 

To get started, we introduce the intermediate process U (t, x) := u x (X(t, z))dz with a simpler 
convex conjugate U(t,y) = X*((u x )~ 1 (z))dz. Denoting by (fl u ,~/ u ) and (fi u ,'y u ) the local 
characteristic of U and U, it follows from the dynamics of X* and the identity U y (t,y) = 
-X* t {-u y {y)) that 

{ P%(t,y) = -r t U v (t,y) -& v (t,v)Kt(-U v (t,y)).rfi 

I , - - (29) 

{ 7 U (t,y) =-U y (t,y) K * t (-U y (t,y)) 

On the other hand, using the correspondence between the diffusion parameters of U and U y 
given in Proposition 13.21 (or equivalently Corollary I3.3p . we have 

ill (t, x) = -U xx {t, x)tf(t, U x (t, x)) 

f(t,x) = f(t,U x (t,x)) + _J^|| 7 £(t >a ;)|| 2 

By this and (|29j) . it is straightforward to check that 

(7^(t,x) = -xU xx (t,x)K* t (x) 
$(t, x) = -xU xx (t, x)r t + 7 £ (t, x).rg + & (^fey I h2(t, x)\\ 2 ) 

In turn, we get that U(t, x) satisfies 

dU(t,x) = P°{t,x)dt + 7°{t,x).dW t with 

-y°(t,x) = - U xx (t,z)zrf(z)dz 

fit, x) = -xU x (t, x)r t + U (t, x)r t + f(t, x).rg + 55^) Ibf (*> *)\? 
As U(t,x) = Y t °U(t,x), Ito's formula leads to 

dU(t, x) = Y t °((3 U (t, x) - U(t, x)r t - j°(t, x).r£)dt + (V t °7^(i, x) - U(t, x)rfi\ .dW t . 

Denote by j(t,x) := Y®j u (t,x) — U(t,x)rjf = — U xx (t, z)zK^(z)dz — U(t,x)rj^, we obtain 
using fi u formula and identities U = Y°U, U x = Y°U X , U xx = Y°U XX that U satisfies the 
desired dynamics given by 

dU(t,x) = ( - U(t,x)r t + — 1 A h x (t,x) + U x (t,x)^\\ 2 )dt + 7 (t,x).dW t 
V 2U xx (t,x) / 
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and j x (t,x) = -U xx (t,x)xK*(x) - U x (t,x)rf. 

Then U is a progressive utility satisfying the utility non linear SPDE, with an optimal wealth 
satisfying equation (|12p of Theorem 12,41 To conclude, it suffices to prove that U(t,X£) is a 
martingale. It is simpler to show this property on the conjugate dual process, since U(yY®) = 
Y® X*(—u(z))dz is a martingale since (Y^X^(z)) is a martingale, by integrability assump- 
tion. By the conjugacy relation, the same property holds for U(t,X£). □ 

Risk tolerance dynamics. With the utility characterization given in Theorem 14.11 the 
study of the risk tolerance coefficient, taken along the optimal wealth, is greatly simplified. In 
particular, the nice martingale property established in He and Huang in [12], in a complete 
market, may be generalized to consistent utilities. 

Proposition 4.2. Let a u (t,x) = — ^ x be the risk tolerance coefficient ofU. 
Then a u {t,X?(x)) = a u (x)X*(t,x), where X*(t, x) is the derivative (assumed to exist) of 
X£(x) with respect to x. Moreover, denoting Y* the partial dervative ofY* with respect to its 
initial condition, the process Y®a u (t, X£(x)) = Y* (t, y)a u (t, X£ (x)) is a local martingale, since 
X*(t,x) is also an admissible portfolio with initial wealth 1. 

Proof. Observe that by definition U xx (t,x) = Y^u xx (X(t,x))X x (t,x). Since X x (t, x) = 1/X*(t, X(t, 
andX(t,X*(t,x)) = x, the formula a v (t,Xf (x)) = a u (x)X*(t, x) is a simple verification. More- 
over, observe that the derivative X*(t,x) (assumed to exist) belongs to the same vector space 
of processes than X£(z), and Y®X*(t,x) is a local martingale. □ 

An extension of this result to the general framework where Y* is not necessarily linear on 
its initial condition is given by Proposition 14.41 

General results. We have shown in Theorem 14.11 that for a monotone wealth process X* , 
Assumption (X*Y° is a martingale) is sufficient in order to construct at least a consistent utility 
whose optimal wealth is X* and the optimal dual process Y*(y) = yY°. The extension to a 
general processes Y* ( not necessarily linear on its initial condition) is suggested by Theorem [33] 
which gives us the general form of consistent utilities using identity U x (t, x) = y o X(t, x) where 
y(t,x) = Y t *(u x (x)). Starting from this identity, we proceed by verification, the ideas are the 
same as in the proof of Theorem 14.11 but the calculations and equations are more complicated 
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due to the fact that the diffusion parameters of a general Y* depond on Y* and not necessarily 
in linear form. 

The general utility characterization result is the following one. 

Theorem 4.3. Let (X£(x) 6 3£) be an admissible wealth process and (Y t *(y)) € <3f be an 
admissible state price density process, regular in the sense of Kunita, such that in addition 
to Assumptions \4-l\ and \4-ty (X*(t,x)Y t *(y)) is a martingale, where by definition X*{t,x) = 

d x x*(t,x). 

Let u be a utility function, and y(t,x) = Y t *(u x (x)), X (t, z) = (X^.))" 1 two regular stochastic 
flows such that x i-> y(t, X(t, z)) is integrable near to zero. 
Define the processes U and U by 

U(t,x)= y(t,X(t,z))dz, U(t,y)= X t *((y)-\t,z))dz. (30) 

JO Jy 

U is a progressive utility, whose convex conjugate is U, and the dynamics 

dU (t, x) = (- xU x (t, x)r t + 1 | | 7 £(i, x) + U x (t, x)rf t j | 2 ) dt + 7 (t, x).dW t , 
V 2U xx {t,x) J 

with volatility vector 7 given by 

7(t,x) = -U(t,x) V ? - J (zU xx {t,z)K* t {z) - u* t {U x {t,z)))dz. 

The associated optimal portfolio and the optimal dual process are X* andY* . Moreover U(t,X£) 
is a martingale, so that U is a SC -consistent stochastic utility. 

In the first theorem of this section we built for a given initial utility function a consistent stochas- 
tic utility with a given optimal wealth process. The extension which we give here characterizes 
all consistent stochastic utilities with the same optimal wealth process. This result expresses 
only how we must diffuse the function U x (0,x) = u x (x) to stay within the framework of con- 
sistent stochastic utilities in incomplete market. The answer is intuitive because it expresses 
the fact that it is enough to keep a monotone field Y* which does not influence the reference 
market. On the other hand it is important to remark that the derivative with respect to x of 
the volatility vector 7 is the sum of two orthogonal vectors and is given by 

j x (t,x) = Vt(U x (t,x)) - U xx (t,x)xKt(x) - U x {t,x)rfi 

= v* t {U x {t,x)) - U^x)^ + j^(t,x)xK* t (x)), 
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and consequently, given k* and u*, it is interpreted as an operator T(t, x, U x , U xx ) which is 
linear on U xx , that depends on U x through the volatility v* of Y* and an affine term on rf , and 
depends on x only through the optimal policy k*. We also emphasize that the term U x /U xx in 
this formula is the risk tolerance of an investor with utility process U. In particular, for the 
case of the market martingale (r/ CT = 0), T(t,x,U x ,U xx ) is linear on U xx , depends on U x only 
through the volatility v* of Y* and on x only through the optimal policy k* . 
Note that in the classical backward set-up of utility maximization, a similar idea is investigated 
by I. Karatzas & al [9]. The authors show also that the solution of a backward SPDE can be 
represented as the composite of two invertible processes. But this differs from the approach 
proposed here because these processes are represented as an expectation of monotonic functions 
(characteristics method) where in this work are stochastic flows. Note that the authors also use 
the Ito-Ventzel formula to establish the backward SPDE. 

Remark . After giving the proof of this result, we want to draw the attention to the fact that 
this theorem can be showed first in the case of the martingale market (r = 0, rf = 0). This 
allows us to simplify the calculations and then we can always comeback to the initial market by 
a technique of change of numeraire. 

Proof. Under Assumption 14. 1 1 the inverse X of X* with respect to x satisfies by Proposition 13.21 



The hypothesis made on X* and Y* entails that we can apply the Ito-Ventzel formula to the 
compound flow y o X. To study U x (t, x) we are first interested on the coefficient of dWt of the 
dynamics of y o X because it represents the derivative of the volatility 7 of the utility U. As 
0?x X)X X = U xx and U x = y o X , formula (|3.ip gives us that 



This identity shows that the vector 7 X is the sum of two orthogonal vectors since the first term 
Vt(U x (t,x)), by hypothesis, belongs to the orthogonal of the second which is —U x (t,x)^r]? + 
(xU xx /U x )(t, x)K*(x) S j that belongs by hypothesis to the space IZ^ . Throughout, the projection 
of -fx on TZf is the vector 7^(i,x) = — xll xx (t, x)k^(x) — U(t,x) x rj1 . 

As U x = y o X, 7 X is the volatility process of U x , it is enough to integrate it with respect to x 
to obtain the result. 



dX(t,x) 



xX x (t, x)kI(x) .dW t + 




7x{t,x) 



u*{U x {t,x)) - xU xx (t : x)4(x) - U x {t,x)ri?. 
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We now focus our interest on the drift [i Ux of the derivative yoX of U. The idea and calculations 
are exactly identical to those of the proof of the previous result. Indeed by the assumptions 
and equation ([20]) . we have 

fi u '(t,x) = -(xX x (t,x)y x o X(t,x) +y o X(t,x))r t 

+\{y x °x){t,x)d x (x x {t,x)\\ X Kt{x)^ 

-xx x (t, x )d x (y o x(t, x)(y* t (y o x(t, x )) - -<(x) - x x x (t, x )y x o x(t, s)«* (x).< . 



Note that in the last line the term — xX x (t, x)d x \y o X(t, x)(u^(y o X(t, x)) —r)f).Kf(x) comes 
from Ito-Ventzel formula and corresponds to < dy x ,dX >. 

To lead the proof we proceed by analyzing line by line the above equality. Using the identities 
(y x ° X(t,x)) x = y xx oX(t, x)X x (t, x) and U xx (t,x) = y x oX(t,x)X x (t,x), the first line becomes 

- (xX x (t,x)y x o X(t,x) + yo X(t,x))r t = - (xU xx + U x ){t,x)r t = -d x (xU x )(t,x)r t . (31) 

Rewritting the second line, we obtain 

o x(t,x)x x (t,x){x x (t,x)\\xK*( x )\\ 2 ) + (y xx o x)(t,x)x x {t,x)d x (x x (t,x)\\x4{x)\\ 2 ) 

= ^d x [y x oX(t,x)X x (t,x)\\xK* t (x)\\ 2 ]. (32) 

Finally, from the assumption that v%(y(t, x)).k£ pQ* (x)) = 0, we deduce vij* (y o X(t, x)).k%(x) = 
and d x (yt(y X(t, x))) .k^ (x) = 0. This yields in the last line to 

- xX x (t, x) \d x (y o X(u*(y o X) - rf) (t, x)) -«J(a?) - 34 ° #(t, xK^.r/f] = 0. (33) 

Identities ([3T]) . ([32]) and ([33]) combined with the expression of \jP x and 7^ yield to 

f jUx (t, x) = dj- xU x (t, x)r t + 1 I |x/< (x) || 2 ). 

V 2U xx {t,x) J 

As J7(i, 0) = we get by integration that U satisfies 

dU(t,x) = {-xU x (t,x)r t + ^U xx (t,x)\\xK* t (x)\\ 2 }dt + 1 (t,x).dW t . 
Using 7^(t, x) + U x (t,x)r}f = — xU xx (t, x)k^ (x) one easily sees that 

dU(t, x) = {-zU.it, x)r t + \ [ M^rr^ ] > dt + x).cW t . 
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It remains to show that U(t,X*) is a martingale, given that the positive process Y*(y)X*(t,x) 
is a martingale by assumption. Then since U(t,X£) = Jq y(t, z)X*(t, z)dz, U(t,X£) is also a 
martingale. The proof is complete. □ 

For more general processes Y* , as in Proposition 14.21 the risk tolerance coefficient of U taken 
along the optimal wealth has a nice properties. 



Proposition 4.4. Under the same assumptions as in Theorem \4-S\ the risk tolerance coefficient 
oF of U is given by 

a =T3 J777 \X O X(t, X). 

y x o x(t,x) 

Where, y{t,x) :=Y*(u x (x)). Moreover, a u (t,X?(x)) = y^^^j X*{t,x) and satisfies : 
Yy(t,y)a u (t,XZ(x)) is a local martingale. 

4.2 Stochastic Flows Method for Solving Stochastic PDE's 

In the previous section using two invertible stochastic flows X* and Y* we construct a consistent 
utility with the desired dynamics. Naturally, the question of the converse point of view is 
required. Starting from a stochastic PDE that satisfy consistent utilities, the question is then 
under which assumptions we have existence and uniqueness of the solution? What can we deduce 
about the monotony and the concavity of a possible solution? Answering these questions is the 
purpose of this section. In the following theorem we propose a new method that allows us to 
address the issue of such resolution of fully nonlinear second order stochastic PDEs . 

Theorem 4.5. Consider a utility stochastic PDE with initial condition u(.), 

dU(t,x) = ( - xU x (t,x)r t + — 1 M (t,x) + U x {t,xX\\ 2 )dt + j{t,x).dW t . (34) 
V 2U xx (t,x) / 

Where the derivative ^ x of 7 is the operator given by 

7*(t,x) = -U x (t,xX ~ xU xx {t,x)K* t (x) + u?(U x (t,x)), 4 G Kl, v* e 7^, t > 0. 
Assume that the both equations 

dX*(r) dY*(ii\ 

^J^=r t dt + K * t (X;(x)).(dW t + V ?dt), -LM = - rt dt+(u;(Y t *(y))-^).dW t (35) 
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admit solutions and that X* is monotonous: [0, +00) — > [0, +00) in its initial condition and it is 
a regular flow in the sense of Kunita. Let y(t, x) = Y t *(u x (x)), X(t,z) = and assume 

x 1— >■ y(t, X(t, z)) is integrable near to zero. Then there exists a solution U of the SPDE (&4\ ) 
given by 



Jo 

Moreover, if X* and Y* are increasing: [0, +00) — >• [0, +00) in their initial conditions and are 
a regular flows in the sense of Kunita, the random field U is an increasing and concave solution 



Theorem 14. 31 shows that for a given X* and Y* increasing solutions of SDEs (|35p the random 
field U(t,x) = Jq y(t, X{t, z))dz is a consistent utility solution of the utility SPDE (|34|) with 
a volatility vector 7 s.t. ^ x (t,x) + U x (t, x)r/f = — xll xx (t, x)kI(x) + u^{U x {t,x)). In this result 
the converse point of view is investigated. Starting from the utility SPDE (|34p with a given 
initial condition u, and a given k* and v* such that —xXJ xx {t,x)K^(x) = j x (t,x) + U x (t,x)r]f 
and i>t(U x (t,x)) = j x t,x), the theorem shows, under the assumption that both the SDE's (|35|) 
admit a solutions and if only X* is invertible then there exist a solution to the SPDE (|34|) 
given by U(t,x) = Jq y(t, X(t, z))dz. If both X* and Y* are strictly increasing regular flows 
the solution U is increasing concave. Moreover, the uniqueness of U is strongly related on the 
uniqueness of the solutions X* and Y* of SDE's (|35|) . Remark that the martingale property of 
the product X*Y* is not required to have a solution of the SPDE where it was necessary to 
conclude that U is a consistent utility in Theorem 14.31 Finally, note that in previous sections 
if the random field U (t, x) is a consistent regular utility then the processes k* and v* ( X* and 
Y*) exists and are regular. 

This is an interesting new approach in which the solution of the utility SPDE have a trajec- 
tory (path wise) representation contrary to the characteristics method where the solutions are 
represented as an expectation. In particular, note that there are several advantages of this 
connection between SPDE's and SDE's. For example, the existence of diverse works in the 
domain of SDE's and seen in the multitude of results on the existence, uniqueness and on the 
integrability of solutions. The monotonicity of solutions X* and Y* gives several properties of 
the solution U of the SPDE. To the best of our knowledge, there are no or few results that 
assert the monotonicity or the convexity of such solutions. Also, there may be other advantages 
in numerical methods and simulations of the SDE than of SPDE. 




of the SPDE (0%). Finally, if X* and Y* are unique then U is the unique solution of \34-\j - 



11 



We finish this section mentioning that the main assumption of Theorem l4.5l is to assume that the 
SDEs (|35p admit a solutions which is a fairly strong assumption because k* and u* may depend 
on higher order derivatives of U. For example in the Markovian case where U (t, x) = u(t, x, Qt), 
according to Example 12.11 the volatility vector 7 of U is given by 

j(t,x,e t ) = Sf V e u{t,x,& t ) 

and the optimal startegy is given by 

£f V e u x (t,x, © t ) 



-XK*(t, x, Qt) 



u xx (t,x,Q t ) 

In other words, for a given policy k* the existence of a solution to the associated SDE in (I35D 
is like an inverse problem. 

Therefore, in the case where the optimal portfolio X£(x) is monotone with respect to its initial 
condition, we have by previous results the following characterization 



X 



u(t,x,Q t )= / Y*(u x (X(t,z)))dz 
Jo 

and in particular u(t, is a solution of the stochastic PDE (|34p . But this is insufficient 

to characterize the function u(t, x, 9) which must satisfy an ordinary PDE of HJB type. So, 
to characterize u(t,x,9), there is a further step that must be overcome. But, if in addition 
of monotony Assumption 14.11 9 1— > @t(Q) is strictly increasing, then using the same method 
of stochastic change of variable we characterize u(t, x, 9) by inverting the global flow (x, 9) 1— > 
XI (x, 9), @t(9)) . Then, we obtain 



u(t,x,9) = Y t *[ Ux (0,X(t,z,et 1 (9)),e^ 1 (9)) i et 1 (0))dz 
Where Y* = Y*(y,6). 

Conclusion This paper investigates consistent stochastic utilities from the stochastic PDEs 
point of view. This leads therefore to make strong regularity assumptions: The market is a 
Brownian market and securities are modeled as continuous semimartingales. Utilities are at 
least of class C^ 2 ' in the sense of Kunita in order to apply Ito-Ventzel Lemma and to deduce the 
SPDEs. Moreover, the method of stochastic utilities construction is based on the dynamics of 
stochastic flows and their inverses, and therefore additional regularity assumptions on X* and 
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Y* are required. However, one can take a direct approach still based on monotony assumptions 
on optimal processes for the primal and dual problem, and on compound flows formula ; it is 
showed in [23], that these assumptions can be considerably weakened. Indeed, considering any 
financial market in which the securities are modeled as bounded semimartingales, the stochastic 
utilities are of class C 1 and wealth process are required to lie in a convex class f C X + , the 
monotony assumption of X* and Y * is sufficient to show the validity of the construction proposed 
in this work, using analysis methods and optimality conditions. 

Appendix 

A Ito-Ventzel's formula 

The Ito-Ventzel's formula is a generalization of classical Ito's formula where the deterministic 
function is replaced by a stochastic process depending on a real or multivariate parameter. There 
are several difficulties in the definition of semimartingale depending on a parameter, as explained 
in H. Kunita [25]. For instance, let us consider the Ito integral of a predictable process ft(x) 
with parameter x in some domain D of R + with respect to some Brownian motion B. Suppose 
that Jq f s (x) 2 ds < +00 holds for each x € D. Then the Ito integral Mt(x) = J * f s (x)dB s is well 
defined for any t except for a null set N x . It is a continuous local martingale with parameter 
x € D. Then Mt(x) is well defined for (t,x) if 00 & {^x£xN x ) c . However the exceptional set 
(U x giiV x ) may not be a null set since it is an uncountable union of null sets. To overcome this 
technical problem we must take a good modification of the random field Mt(x) so that it is well 
defined for all (t, x) a.s. and is continuous or continuously differentiable with respect to x for 
all t almost surely. 

A.l Notation and Definition 

Functional spaces We shall first introduce some notations. Let D be a domain in R + , m 
an non- negative integer and denote by C m (D,R) the set of all functions g : D — > R which are 
m-times continuously differentiable. Using the notation for the derivative of order m of 
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some function g, we introduce the seminorms denned on some compact subset of D by 

II II |gQ)l V- | fa)/ m 

\\g\\m:K = SUp + > SUp ' X . 

^ifl + F x£K 
l<a<m 

Equipped with these seminorms, C m (D, R) is a Frechet space. When D itself is a compact space 
we drop out the reference to K. 

We sometimes need to refer to more regular functions whose derivatives of order m are 5-Holder 
continuous (0 < 5 < 1). Then we introduce a new family of seminorms, 

\g( m \x) -g {m) {y)\ 

\\g\\m+S:K = \\g\\m:K + SUp ; rj . 

x,y£K \X — y\ 

x^y 

on the set of C m (D,lR) whose last derivative is 5- Holder continuous. 

Definition A.l. A continuous function f(t, x), x 6 X, t > is said to belong to C m,s , 5 6 [0, 1] 
if for every t, f(t) = f(t, .) belongs to C m ' S and \ \f(t)\ \ m +8:K is integrable with respect to t for 
any compact subset K of I. If the set K is X, the function f is said to belong to the class C™' S . 
Furthermore, if ||/(t)|| m +,5 is bounded in t it is said to belongs to C™^ S 

We also need to introduce the same kind of definition for functions depending on two pa- 
rameters 

\\9\L+S:K = \ \9\\m:K + Yl W 9 x d y 9( X ' VW.K 

a=m 

ii n~ \g(x,y) - g(x',y) - g(x,y') + g{x',y')\ 

\\g\\S:K — SU P j — _ n s\ — _ ,\S ■ 

x,x',y,y'£K \ x x I \D V I 

Definition A. 2. A continuous function g(t,x,y), x,y € I, t € [0,T] is said to belong to 
C m ' S ,5 G [0,1] if for every t, g(t) = g(t,.,.) belongs to C m,s and \\g{t)\\^ n+ ^. K is integrable on 
[0, T] with respect to t for any compact subset K of I. If the set K is X, the function g is said 
to belong to the class C™' S . Furthermore, if ||5 f (i)Hm+<5 * s bounded in t it is said to belong to 

C m,<5 -process : Let U(t, x) a family of real valued process with parameter x € X. We can 
regard it as a random field with double parameter t and x. If U(t, x, oo) is a continuous function 
of x for almost all uo for any t, we can regard U(t, .) as a stochastic process with values in 
C = C(I, M) or a C-valued process. If U(t,x,uj) is m-times continuously differentiable with 
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respect to x for almost all uj for any t, it can be regarded as a stochastic process with values 
in C m = C m (I, R) or a C m -valued process. If U(t,x) is a continuous process with value in C m , 
it is called a continuous C m -process. A C m ' 5 -valued process and continuous C m ' -processes are 
defined similarly. 

C m<5 -process : Let G(t, x, y) be a stochastic process with parameter x, y € X. If it is m-times 
continuously differentiable with respect to each x and y a.s. for any t, it is called a stochastic 
process with values in C m or a C m -valued process. The C m,<5 -valued process and continuous 
C^-valued process are defined similarly. 

Theorem A.l. Let Mf(x), x 6 I be a family of continuous local martingales such that M${x) = 
0. Assume the joint quadratic variation < Mt(x),Mt(y) > has a modification A(t,x,y) of a 
continuous C m ' S -process for some m > 1 and 5 € (0, 1]. Then Mt(x) has a modification of a 
continuous C m ' £ -process for any e < 5. Furthermore, for each n > m, d%Mf(x), x € I is a 
family of continuous local martingales with joint quadratic variation d™dyA(t,x,y). 

Definition A. 3. We shall call the random field Mt{x) with the property of the previous Theorem 
a continuous local martingale with values in C m,e or a continuous C m ' £ -localmartingale. 

Regular Ito's random fields C m<5 -semimartingale : Suppose U(t,x), x G 1 is a 
family of continuous semimartingale decomposed as U(t,x) = B(t,x) + M(t,x), where M(t,x) 
is a local martingale and B{t, x) is a continuous process of bounded variation. U(t,x), xGlis 
said to belong to the class C m ' S or simply to be C^-semimartingale if M(t, x) is a continuous 
C m ' a -local martingale and B(t,x) is a continuous C m,<5 -process such that D^B(t,x), a <m are 
all process of bounded variation. Further if 5 = it is called a C m -semimartingale. 
Let U be a semimartingale satisfying 

dU(t, x) = f3(t, x)dt + 7(t, x).dW t , U(r, x) = U(x), 

where j3 and 7 are predictable process. 

Definition A. 4 (Kunita). 

• The pair (/?, 7) is called the local characteristic of U . 

• Let m be a non-negative integer and a(t,x,y) := j(t,x)*j(t,y). The local characteristic 
(/3, 7) is said to be in the class B m '° if both (3 and a are predictable process with value C m and 
if for any compact subset K\ C R+ and K2 C R+ xR + .)||m:Xn \\a(t, ., Ollm-ifo ^ L 1 ■ 
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Where 



m: Kl = sup + SU P 1^/(^)1- 



\9\\Z-.k 2 = sup -— — l— — + ]T sup \r%D2g(x,y)\ 
x,y&K 2 I 1 + FlJU + WD i^ui^^J/eifs 



l<|a|<m 

Definition A. 5 (Ito-Ventzel Regularity). A semimartingale random field U is said to be Itd- 
Ventzel regular if U is a continuous C 2 -process and continuous C 1 -semimartingale with local 
characteristic satisfying previous assumption . 

Theorem A. 2 (Ito-Ventzel's Formula (Kunita)). Let (U(t,x)) be an Ito-Ventzel regular semi- 
martingale random field and let Xt be a continuous semimartingale with values in X and volatility 
a , then U(t,Xt) is a continuous semimartingale and 

U(t,X t ) = U(0,X )+ [ P{s,X s )ds+ [ 7 (s,X s ).dW s 

Jo Jo 

f l dU f* d 2 U 

+ J — (s,X s )dX s + J -q-j(s,X s ) <X > s ds 

Jo ox 

Furthermore, according to H. Kunita [25] Theorem 3.3.3 p. 94 we have the following differ- 
ential rules for stochastic integrals. 

Theorem A. 3 (Differential rules for stochastic integrals). Let F(t,x) be a continuous C m,s - 
semimartingale with local characteristic belonging to the class B m,s where 5 > 0. Let X(t,x), x G 
A, t 6 [0,T] be a continuous predictable process with values in C fc ' 7 (A,X) where 7 > and 
Acl e . Set 

M(t,x) = [ F(X(s,x),ds). 
Jo 

(i) Then M(t, x) has a modification of continuous C m,i -semimartingale with values inC mAk ' £ (A, 
with local characteristic belonging to the class J g mAfc >7<5 with e < j6. 

Further if gt is a continuous predictable process with values in A, then we have the equality: 

[ M(ds, g s )= [ F(X(s, g s ), ds). (36) 
Jo Jo 
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(ii) If m > 1 and k > 1, then we have the equality: 

i=l JU 
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